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METHOD AND APPARATUS FOR REHABILITATION 
OF NEUROMOTOR DISORDERS 

Background of the Invention 

This application claims priority of U.S. Provisional Application Serial No. 
60/248,574 filed November 16, 2000 and U.S. Provisional Application Serial No. 
60/329,31 1 filed October 16, 2001, which are hereby incorporated by reference in their 
entireties. 

1. Field of the Invention 

The present invention relates to a method and apparatus for rehabilitation of 
neuromotor disorders such as improving hand function, in which a system provides 
virtual reality rehabilitation exercises with index of difficulty determined by the 
performance of a user (patient). 

2. Description of the Related Art 

The American Stroke Association states that stroke is the third leading cause of 
death in the United States and a major cause for serious, long-term disabilities, as 
described in http://www.strokeassociation.org/, 2001 . Statistics show that there are more 
than four million stroke survivors living today in the US alone, with 500,000 new cases 
being added each year. Impairments such as muscle weakness, loss of range of motion, 
decreased reaction times and disordered movement organization create deficits in motor 
control, which affect the patient's independent living. 

Prior art therapeutic devices involve the use of objects which can be squeezed 
such as balls which are held in the patient's hand and the patient is instructed to apply 
increasing pressure on the surface of the ball. This device provides for resistance of the 
fingers closing relative to the palm, but has the limitation of not providing for exercise of 
finger extensions and finger movement relative to the plane of the palm and does not 
provide for capturing feedback from the patient's performance online. 

It has been described that intensive and repetitive training can be used to modify 
neural organization and recover functional motor skills For post-stroke patients in the 
chronic phase. See for example, Jenkins, W. and M. Merzenich, "Reorganization of 



1419-151 US 



Neocortical Representations After Brain Injury: A Neurophysiological Model of the 
Bases of Recovery From Stroke " in Progress in Brain, F. Seil, E. Herbert and B. 
Carlson, Editors, Elsevier, 1987; Kopp, Kunkel, Muehlnickel, Villinger, Taub and Flor, 
"Plasticity in the Motor System Related to Therapy-induced Improvement of Movement 
5 After Stroke," Neuroreport, 10(4), pp. 807-10, March 17, 1999; Nudo, RJ, "Neural 
Substrates for the Effects of Rehabilitative Training on Motor Recovery After Ischemic 
Infarction," Science, 272: pp. 1791-1794, 1996; and Taub, E. et al, "Technique to 
Improve Chronic Motor Deficit After Stroke," Arch Phys Med Rehab, 1993, 74: pp. 347- 
354. 

1 0 When traditional therapy is provided in a hospital or rehabilitation center, the 

patient is usually seen for half-hour sessions, once or twice a day. This is decreased to 
once or twice a week in outpatient therapy. Typically, 42 days pass from the time of 
hospital admission to discharge from the rehabilitation center, as described in P. Rijken 
and J. Dekker, "Clinical Experience of Rehabilitation Therapists with Chronic Diseases: 
15 A Quantitative Approach," Clin, Rehab, vol. 12, no. 2, pp. 143-150, 1998. Accordingly, 
in this service-delivery model, it is difficult to provide the amount or intensity of practice 
needed to effect neural and functional changes. Furthermore, little is done for the 
millions of stroke survivors in the chronic phase, who face a lifetime of disabilities. 

Rehabilitation of body parts in a virtual environment has been described. U.S. 
20 Patent No. 5,429,140 issued to one of the inventors of the present invention teaches 
applying force feedback to the hand and other articulated joints in response to a user 
(patient) manipulating an virtual object. Such force feedback may be produced by an 
actuator system for a portable master support (glove) such as that taught in US Patent 
5,354,162 issued to one of the inventors on this application. In addition, U.S. Patent No. 
25 6, 1 62, 1 89 issued to one of the inventors of the present invention, describes virtual reality 
simulation of exercises for rehabilitating a user's ankle with a robotic platform having six 
degrees of freedom. 

Summary of the Invention 

The invention relates to a method and system for individually exercising one or 
30 more parameters of hand movement such as range, speed, fractionation and strength in a 
virtual reality environment and for providing performance-based interaction with the user 
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(patient) to increase user motivation while exercising. The present invention can be used 
for rehabilitation of patients with neuromotor disorders, such as a stroke. A first input 
device senses position of digits of the hand of the user while the user is performing an 
exercise by interacting with a virtual image. A second input device provides force 
5 feedback to the user and measures position of the digits of the hand while the user is 
performing an exercise by interacting with a virtual image. The virtual images are 
updated based on targets determined for the user's performance in order to provide harder 
or easier exercises. Accordingly, no matter how limited a user's movement is, if the user 
performance falls within a determined parameter range the user can pass the exercise trial 
10 and the difficulty level can be gradually increased. Force feedback is also applied based 
on the user's performance, and its profile is based on the same targeting algorithm. 

The data of the user's performance can be stored and reviewed by a therapist. In 

h* one embodiment, the rehabilitation system is distributed between a rehabilitation site, a 

Q 

q data storage site and a data access site through an Internet connection between the sites. 

S 1 5 The virtual reality simulations provide an engaging environment that can help a therapist 

*p to provide an amount or intensity of exercises needed to effect neural and functional 

m changes in the patient. The invention will be more fully described by reference to the 

? following drawings. 

U In a further embodiment, the data access site includes software that allows the 

20 doctor/therapist to monitor the exercises performed by the patient in real time using a 
graphical image of the patient's hand. 

Brief Description of the Drawings 

Fig. 1 is a schematic diagram of a rehabilitation system in accordance with the 
teachings of the present invention. 
25 Fig. 2a is a schematic diagram of a pneumatic actuator that is used in a force 

feedback glove of the present invention. 

Fig. 2b is a schematic diagram of an attachment of the pneumatic actuator to a 
digit of a hand. 

Fig. 2c is a schematic diagram of measurement of a rotation angle of the digit. 
30 Fig. 3 is a schematic diagram of a rehabilitation session structure. 
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Fig. 4 is a graph of mean performance and target levels of a range of movement of 
a user's index finger. 

Fig. 5a is a pictorial representation of a virtual simulation of an exercise for range 
of motion. 

Figure 5b is a pictorial representation of another version of the range of motion 
exercise in virtual reality. 

Fig. 6a is a pictorial representation of a virtual simulation of an exercise for speed 
of motion. 

Figure 6b is a pictorial representation of another version of the speed of motion 
exercise in virtual reality. 

Fig. 7 is a pictorial representation of a virtual simulation of an exercise for finger 
fractionation. 

Fig. 8 is a pictorial representation of a virtual simulation of an exercise for 
strength of motion. 

Fig. 9a is a pictorial representation of a graph for performance of the user 
following an exercise. 

Figure 9b is a pictorial representation of another version of the user performance 
graph during virtual reality exercising. 

Fig. 10 is a schematic diagram of an arrangement of tables in a database. 

Fig. 1 la is a schematic diagram of a distributed rehabilitation system. 

Figure 1 lb is a detail of the patient monitoring server screen. 

Fig. 12a is a graph of results for thumb range of motion. 

Fig. 12b is a graph of results for thumb angular velocity. 

Fig. 12c is a graph of results for index finger fractionation. 

Fig. 1 2d is a graph of results for thumb average session mechanical work. 

Fig. 13a is a graph of dynamometer readings for the left hand of subjects. 

Fig. 13b is a graph of dynamometer readings for the right hand of subjects. 

Fig. 14 is a graph of daily thumb mechanical work during virtual simulation of 
exercises. 

Fig. 15 shows improvement from four patients using the rehabilitation system. 
Fig 16 shows the rehabilitation gains made in two patients. 
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Fig. 17 shows the results of a Jebsen evaluation. 

Fig. 18 shows the transfer-of-training results for a reach-to-grab task. 

Detailed Description 

Reference will now be made in greater detail to a preferred embodiment of the 
5 invention, an example of which is illustrated in the accompanying drawings. Wherever 
possible, the same reference numerals will be used throughout the drawings and the 
description to refer to the same or like parts. 

Fig. 1 is a schematic diagram of rehabilitation system 10 in accordance with the 
teachings of the present invention. Patient 1 1 can interact with sensing glove 12. 
10 Sensing glove 12 is a sensorized glove worn on the hand for measuring positions of the 
patient's fingers and wrist flexion. A suitable such sensing glove 12 is manufactured by 
LjL Virtual Technologies, Inc. as the CyberGlove™. For example, sensing glove 12 can 

O include a plurality of embedded strain gauge sensors for measuring metacarpophalangeal 

p (MCP) and proximal interphalangeal (PIP) joint angles of the thumb and fingers, finger 

*2 15 abduction and wrist flexion. Sensing glove 12 can be calibrated to minimize 

0 measurement errors due to hand-size variability. The patient's hand joint is placed into 

inn 

* ? two known positions of about 0° and about 60°. From these measurements, parameters of 

jff gain and offset are obtained that determine the linear relation between the raw glove- 

h* sensor output (voltages) and the corresponding hand-joint angles being measured. An 

JiS 20 alternative way of calibration is to use goniometers placed over each finger joint and map 
N : the readings to those obtained from sensing glove 12. Sensing glove 12 can be used for 

exercises which involve position measurements of the patient's fingers, as described in 

more detail below. 

Patient 1 1 can also interact with force feedback glove 13. For example, force 
25 feedback glove 13 can apply force to fingertips of patient 1 1 and includes noncontact 

position sensors to measure the fingertip position in relation to the palm. A suitable force 
feedback glove is described in PCT/US00/19137; D. Gomez, "A Dextrous Hand Master 
With Force Feedback for Virtual Reality," Ph.D. Dissertation, Rutgers University, 
Piscataway, NJ, May 1997 and V. Popescu, G. Burdea, M. Bouzit, M. Girone and V. 
30 Hentz, "Orthopedic Telerehabilitation with Virtual Force Feedback," IEEE Trans. 
Inform. Technol Biorned, Vol. 4, pp. 45-51, March 2000, hereby incorporated by 



5 



1419-151 US 



reference in their entireties into this application. Force feedback glove 13 can be used for 
exercises which involve strength and endurance measurements of the user's fingers, as 
described in more detail below. 

Figs. 2a-2c illustrate an embodiment of a pneumatic actuator which can be 
attached by force feedback glove 13 to the tips of digits of the hand of a thumb, index, 
middle and ring finger of patient 1 1 . Each pneumatic actuator 30 can apply up to about 
16 N of force when pressurized at about 100 psi. The air pressure is provided by a 
portable air compressor (not shown). Sensors 32 inside each pneumatic actuator 30 
measures the displacement of the fingertip with respect to exoskeleton base 34 attached 
to palm 35. Sensors 32 can be infrared photodiode sensors. Sensors 36 can be mounted at 
base 37 of actuators 30 to measure flexion and abduction angles with respect to 
exoskeleton base 34. Sensors 36 can be Hall Effect sensors. 

In order to determine the hand configuration corresponding to the values of the 
exoskeleton position sensors, the joint angles of three fingers and the thumb, as well as 
finger abduction, can be estimated with a kinematic model. 

Representative equations for the inverse kinematics are: 
aj Sj + a 2 S }+ 2 + a 3 Si+2+3 = DS T + h 
aj Cj + a 2 + a 3 C }+2+ 3 = D C r - 1. 

Additionally, the following constraint equation can be imposed for © 3 and © 2 : 

© 3 = 0.46 ©2 + 0.083 (0 2 ) 2 

The system can be solved using least-squares linear interpolation. Calibration of 
force feedback glove 13 can be performed by reading sensors 32 and 36 while the hand is 
completely opened. The values read are the maximum piston displacement, minimum 
flexion angle, and neutral abduction angle. 

Referring to Fig. 1, sensor data 14 from sensor glove 12 and force feedback glove 
13 is applied to interface 15. For example, interface 15 can include a RS-232 serial port 
for connecting to sensor glove 12. Interface 15 can also include a haptic control interface 
(HCI) for controlling desired fingertip forces and calculating joint angles of force 
feedback glove 13. Interface 15 can receive sensor data 14 at a rate in the range of about 
100 to about 200 data sets per second. 
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Data 16 is forwarded from interface 15 to virtual reality simulation module 18, 
performance evaluation module 19 and database 20. Virtual reality simulation module 18 
comprises virtual reality simulations of exercises for concentrating on a particular 
parameter of hand movement. For example, virtual reality simulations can relate to 

5 exercises for range, speed, fractionation and strength, which can be performed by a user 
of rehabilitation system 10, as shown in Fig. 3. Fractionation is used in this disclosure to 
refer to independence of individual finger movement. Virtual simulation exercises for 
range of motion 41 are used to improve a patient's finger flexion and extension. In 
response to the virtual simulation of exercises for range of motion 41, the user flexes the 

10 fingers as much as possible and opens them as much as possible. During virtual 

simulation of exercises for speed-of-motion 42, the user fully opens the hand and closes it 
as fast as possible. Virtual simulation exercises for fractionation 43 involve the use of the 
index, middle, ring, and small fingers. In response to virtual simulation exercises for 
fractionation 43, the patient flexes one finger as much as possible while the others are 

15 kept open. The exercise is executed separately for each of the four fingers. Virtual 
simulation exercises for strength 44 are used to improve the patient's grasping 
mechanical power. The fingers involved are the thumb, index, middle, and ring. In 
response to virtual simulation exercises for strength 44, the patient closes the fingers 
against forces applied to fingertips by feedback glove 13 to try to overcome forces 

20 applied by feedback glove 13. The patient is provided with a controlled level of force 
based on his grasping capacity. 

To reduce fatigue and tendon strain, the fingers are moved together and the thumb 
is moved alone in response to virtual simulation exercises for range of motion 41, 
exercises for speed 42 and exercises for strength 44. Each exercise is executed separately 

25 for the thumb because, when the whole hand is closed, either the thumb or the four 
fingers does not achieve full range of motion. Executing the exercise for the index, 
middle, ring, and small fingers at the same time is adequate for these exercises because 
the fingers do not affect each-others' range of motion. 

The rehabilitation process is divided into session 50, blocks 52a-52d, and trials 

30 54a-54d. Trials 54a-54d comprise execution of each of virtual simulation exercises 41- 
44. For example, closing the thumb or fingers is a range-of-motion trial 54a. Blocks 
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52a-52d are a group of trials of the same type of exercise. Session 50 is a group of blocks 
52a-52d, each of a different exercise. 

During each trial 54a-54d, exercise parameters for the respective virtual 
simulation exercises 41-44 are estimated and displayed as feedback at interface 15. After 
5 each trial 54a-54d is completed, sensor data 14 can be low pass-filtered to reduce sensor 
noise. For example, sensor data 14 can be filtered at about 8 Hz. Data 16 is evaluated in 
performance evaluation module 19 and stored in database 20. In performance evaluation 
module 19, the patient's performance is calculated per trial 54a-54d and per block 52a- 
52d. In performance evaluation module 19, performance can be calculated as the mean 
10 and the standard deviation of the performances of trials 54a-54d involved. For exercises 
for range of motion 41 and exercises for strength 44, the flexion angle of the finger is the 
mean of the MCP and PIP joint angles. The performance measure is found from: 

/ MCP + PIP \ . /MCP±£IP\ 
max [ 2 — ) - nun ^ 2 — ) ' 

The finger velocity in exercises for speed of motion 42 is determined as the mean 
1 5 of the angular velocities of the MCP and PIP joints. The performance measure is 
determined by: 

/ speed(MCP) + speed(PIP) \ . 

max ^ 2 J 

Finger fractionation in the exercise for fractionation 43 is determined by: 

mno/ (1 SPassiveFingerRange \ 
lUU/o \l - 3 ActiveFingerRange J 

20 where ActiveFingerRange is the current average joint range of the finger being moved 
and PassiveFingerRange is the current average joint range of the other three fingers 
combined. Moving one finger individually results in a measure of 100%, which decays to 
zero as more fingers are coupled in the movement. The patient moves only one finger 
while trying to keep the others stationary. This exercise can be repeated four times for 

25 each finger. 

An initial baseline test is performed of each of exercises 41-44 to determine an 
initial target 22. The range of movement of force feedback glove 13 is performed to 
obtain the user's mean range while wearing force feedback glove 13. The user's finger 
strength is established by doing a binary search of force levels and comparing the range 
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of movement at each level with the mean obtained from the previous range test. If the 
range is at least 80% of that previously measured, the test is passed, and the force is 
increased to the next binary level. If the test is failed, then the force is decreased to the 
next binary level, and so on. Test forces are applied until the maximal force level 

5 attainable by the patient is found. During the baseline test for exercise for strength 44, 
the patient uses force feedback glove 13. 

Targets are used in performance evaluation module 19 to evaluate performance 
21 . A first set of initial targets 22 for the first session, are forwarded from database 20. 
Initial targets 22 are drawn from a normal distribution around the mean and standard 

10 deviations given by the initial evaluation baseline test for each of exercises 41-44. A 
normal distribution ensures that the majority of the targets will be within the patient's 
performance limits. 

After a blocks 52a-52d are completed, the distribution of the patient's actual 
performance 21 is compared to the preset target mean and standard deviations in new 

1 5 target calculation module 23 . If the mean of the patient' s actual performance 2 1 is 

greater than the mean of target 22, target 22 is raised by one standard deviation to form a 
new target 24. Alternatively, target 22 for the next session is lowered by the same 
amount to form new target 24. The patient will find some new targets 24 easy or difficult 
depending on whether they came from the low or high end of the target distribution. 

20 Initially, in one embodiment, the target means are set one standard deviation above the 
user's actual measured performance to obtain a target distribution that overlaps the high 
end of the user's performance levels. New targets 24 are stored in database 20. Virtual 
reality simulation module 18 can read database 20 for displaying performance 21, targets 
22 and new targets 24. To prevent new targets 24 from varying too little or too much 

25 between sessions, lower and upper bounds can be placed by new target calculation 

module 23 upon their increments. These parameters allow a therapist monitoring use of 
rehabilitation system 10 by a patient to choose how aggressively each training exercise 
41-44 w iH proceed. A high upper bound means that new targets 24 for the next session 
are considerably higher than the previous ones. As new targets 24 change over time, they 

30 provide valuable information to the therapist as to how the user of rehabilitation system 
10 is coping with the rehabilitation training. 
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The new targets for blocks 52a-52d and actual mean performance of the index 
finger during the range exercise are shown for four sessions taken over a two-day period, 
in Fig. 4. Columns 55a-55b are the result of the initial subject evaluation target 22 being 
set from the mean actual performance plus one standard deviation. As the exercises 
5 proceed, it can be seen how new targets 24 were altered based upon the subject's 

performance in columns 56-59. New target 24 of blocks 52a-52d was increased when the 
user matched or improved upon the target level, or decreased otherwise. 

Virtual reality simulation module 18 can develop exercises using the 
commercially available WorldToolKit graphics library as described in Engineering 
1 0 Animation Inc., WorldToolKit, http://www.eai.com/propducts /sense8/worldtoolkit.html , 
or some other suitable programming toolkit. Virtual reality simulations can take the form 
of simple games in which the user performs a number of trials of a particular task. 
Virtual reality simulations of exercises are designed to attract the user's attention and to 
challenge him to execute the tasks. In one embodiment during the trials, the user is 
1 5 shown a graphical model of his own hand, which is updated in real time to accurately 
represent the flexion of his fingers and thumb. The user is informed of the fingers 
involved in trial 54a-54d by highlighting the appropriate virtual fingertips in a color, such 
as green. The hand is placed in a virtual world that is acting upon the patient's 
K* performance for the specific exercise. If the performance is higher than the preset target, 

!*j 20 then the user wins the game. If the target is not achieved in less than one minute, the trial 
*f ends. 

An example of a virtual simulation of exercise for range of movement 41 is 
illustrated in Fig. 5a. The patient moves a virtual window wiper 60 to reveal an attractive 
landscape 61 hidden behind the fogged window 62. The higher the measured angular 
25 range of movement of the thumb or fingers (together), the more wiper 60 rotates and 
clears window 62. The rotation of wiper 60 is scaled so that if the user achieves the 
target range for that particular trial, window 62 is cleaned completely. 

Fogged window 62 comprises a two-dimensional (2-D) array of opaque square 
polygons placed in front of a larger polygon mapped with a landscape texture. Upon 
30 detecting the collision with wiper 60, the elements of the array are made transparent, 
revealing the picture behind it. Collision detection is not performed between wiper 60 
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and the middle vertical band of opaque polygons because they always collide at the 
beginning of the exercise. These elements are cleared when the target is achieved. To 
make the exercise more attractive, the texture (image) mapped on window 62 can be 
changed from trial to trial. 

Another embodiment of the range of motion exercise is shown in Figure 5b. The 
region of opaque squares covering the textured image is subdivided in four bands 204- 
207, each corresponding to one finger. Thus the larger the range of motion of the index 
finger, the larger the corresponding portion of the textured image is revealed. The same 
process is applied for middle, ring and pinkie fingers, in order to help the therapist see the 
range of individual fingers. 

An example of a virtual simulation exercise for speed of movement 42 is designed 
as a "catch-the-ball game," as illustrated in Fig. 6a. The user competes against a 
computer-controlled opponent hand 63 on the left of the screen. On a "go" signal for 
example, a green light on traffic signal 64, the user closes either the thumb or all the 
fingers together as fast as possible to catch ball 65, such as a red ball which is displayed 
on virtual simulated user hand 66. At the same time, opponent hand 63 also closes its 
thumb or fingers around its ball. The angular velocity of opponent hand 63 goes from 
zero to the target angular velocity and then back to zero, following a sinusoid. If the 
patient surpasses the target velocity, then he beats the computer opponent and gets to 
keep the ball. Otherwise, the patient loses, and his ball falls, while the other ball remains 
in opponent's hand 63. 

Another embodiment of the speed of movement exercised is illustrated in Fig. 6b. 
The game is designed as a "scare-the-butterfly" exercise. The patient wearing the sensing 
glove 12 has to close the thumb, or all the fingers, fast enough to make butterfly 300 fly 
away from virtual hand 302. If the patient does not move his fingers or thumb with 
enough speed which can be a function of target 22 then butterfly 300 continues to stay 
at the extremity of palm 304 of virtual hand 302. 

An example of a virtual simulation exercise for fractionation 43 is illustrated in 
Fig. 7. The user interacts with a virtual simulation of a piano keyboard 66. As the active 
finger is moved, the corresponding key on the piano 67 is depressed and turns a color, 
such as green. Nearing the end of the move, the fractionation measure is calculated 



11 



1419-151 US 



online, and if it is greater than or equal to the trial target measure, then only that one key 
remains depressed. Otherwise, other keys are depressed, and turn a different color, such 
as red, to show which of the other fingers had been coupled during the move. The goal of 
the patient is to move his hand so that only one virtual piano key is depressed for each 
trial. This exercise is performed while the patient wears sensing glove 12. 

Fig. 8 illustrates a virtual simulation of an exercise for strength 44. A virtual 
model of a force feedback glove 68 is controlled by the user interaction with force 
feedback glove 13. The forces applied for each individual trial 54a-54d are taken from a 
normal distribution around the force level found in the initial evaluation. As each 
actuator 30 on the force feedback glove 13 is squeezed, each virtual graphical actuator 69 
starts to fill from top to bottom in a color, such as green, proportional to the percentage of 
the displacement target that had been achieved. Virtual graphical actuator 69 turns 
yellow and is completely filled if the patient manages to move the desired distance 
against that particular force level. 

Each actuator 30 of force feedback glove 13 has two fixed points: one in the palm, 
attached to exoskeleton base 34, and one attached to the fingertip. Virtual graphical 
actuator 69 is implemented with the same fixed points. In one implementation, the 
cylinder of virtual graphical actuator 69 is a child node of the palm graphical object, and 
the shaft is a child node of the fingertip graphical object. To implement the constraint of 
the shaft sliding up and down in the cylinder, for each frame, the transformation matrices 
of both parts are calculated in the reference frame of the palm. Then, the rotation of the 
parts is computed such that they point to one another. 

An example of digital performance meter visualizing the patient's progress is 
shown in Fig. 9a. After every trial is completed for any of the previously described 
virtual simulations of exercises 41-44, the patient is shown this graphical digital 
performance meter by virtual reality simulation module 18. Virtual digital performance 
meter visualizes the target level as a first color horizontal bar 400, such as red, and the 
user's actual performance during that exercise as similar second color bars 402, such as 
green and informs the user of how his performance compares with the desired one. 

In another embodiment illustrated in Fig. 9b, the digital performance meter is 
displayed during the exercise, at the top of the screen graphical user interface. The 
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performance meter is organized as a table. Columns 406a-e correspond to the thumb and 
fingers while rows 408a-b of numbers show target and instantaneous performance values. 
This embodiment presents the performance in numerical, rather than graphic format, and 
it displays it during rather than after the exercise. It has been found that this embodiment 
5 is motivates the patients to exercise, since they receive real-time performance feedback. 
If during the exercise the target has been matched or exceeded by the patient, that table 
cell changes color and flashes, to attract patient (or therapist's) attention. 

Fig. 10 illustrates a structure 70 for storing data of exercises 41-44 in database 20. 
Database 20 provides expeditious as well as remote access to the data. Patient's table 71 
1 0 stores information about the condition of the patient, prior rehabilitation training, and 
results of various medical tests. Sessions table 72 contains information about a 
rehabilitation session such as date, time, location, and hand involved. Blocks table 73 
stores the type of the exercise, the glove used, such as sensing glove 12 or force feedback 
glove 13 and the version of the data. The version of the data is linked to an auxiliary 
1 5 table containing information about the data stored and the algorithms used to evaluate it. 
For each exercise, there is a separate trials table 74 containing mainly control information 
about the status of a trial. There are four data tables 76, one for each exercise. Data 
tables 76 store the sensor readings taken during the trials. For each exercise, there is a 
U separate baselines data table 76 storing the results of the initial evaluation. The target and 

20 performance tables 77-80 contain this information computed from sensor readings. 

A frequent operation on database 20 is to find out to whom an entry belongs. For 
example, it may be desirable to know which patient executed a certain trial 74a-74d. To 
speed up queries of database 20, the keys of tables on the top of map 70 are passed down 
more than one level. Due to the large size of the data tables 76, the only foreign key 
25 passed to them is the trial key. The data access is provided through a user name and 
password assigned to each patient and member of the medical team. 

Fig. 1 la is a schematic diagram of distributed rehabilitation system 100. 
Rehabilitation system 100 is distributed over rehabilitation site 102, data storage site 1 10 
and data access site 120 connected to each other through Internet 101. Rehabilitation site 
30 1 02 is the location where the patient is undergoing upper extremity therapy. 

Rehabilitation site 102 includes computer workstation 103, sensing glove 12 and force 
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feedback glove 13 and local database 104. Sensing glove 12, force feedback glove 13 are 
integrated with virtual reality simulation module 18 generating exercises running on 
computer workstation 103. The patient interacts with rehabilitation site 102 using 
sensing glove 12 and force feedback glove 13. Feedback is given on a display of 
computer workstation 103. Local database 104 stores data from virtual reality simulation 
module 18. Local database 104 interacts with a central database 1 12 of data storage site 
110 using a data synchronization module 106. 

Data storage site 1 10 is the location of main server 111. Main server 1 1 1 hosts 
central database 1 12, monitoring server 1 13 and web server 1 14. If the network 
connection is unreliable (or slow), then data is replicated from central database 1 12 in 
local database 104. Central database 1 12 is synchronized with local database 104 with a 
customizable frequency. Data access site 120 comprises computers with Internet access 
which can have various locations. Using web browser 121, a therapist or physician can 
access web portal 122 and remotely view the patient data from data access site 110. To 
provide the therapist with the possibility of monitoring the patient's activity the client- 
server architecture brings the data from rehabilitation site 102 to data storage site 1 10 in 
real-time. Main server 1 1 1 stores only the last record data. Due to the small size of the 
data packets and the lack of atomic transactions, the communication works even over a 
slow connection. 

Web portal 122 can be implemented as Java applet that accesses the data through 
Java servlets 115 running on data storage site 110. The therapist can access stored data, 
or monitor active patients, through the use of web browser 121 . Web portal 122 provides 
a tree structure for intuitive browsing of the data displayed in graphs such as performance 
histories (day, session, trial), linear regressions, or low-level sensor readings. For 
example, the graphs can be generated in PDF. 

In one embodiment of the present inventions, virtual reality module 18 can 
provide real-time monitoring of the patient through a Java3D applet displaying a 
simplified virtual hand model, as illustrated in Fig. 1 lb The virtual hand's finger angles 
are updated with the data retrieved from monitoring server 113 at the data storage site. 
The therapist can open multiple windows of browser 121 for different patients, or select 
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from multiple views of the hand of a given patient. The window at the monitoring site 
displays the current exercise session, or trial number as well as patient ID. 

EXAMPLES 

Rehabilitation system 10 was tested on patients during a two-week pilot study. 
All subjects were tested clinically, pre- and post-training, using the Jebsen test of hand 
function as described in R. H. Jebsen, N. Taylor, R. B. Trieschman, M. J. Trotter and L. 
A. Howard, "An Objective an Standardized Test of Hand Function," Arch. Phys. Med. 
Rehab., Vol. 50, pp. 311-319, 1969, merely incorporated by reference into this applicant 
and the hand portion of the Fugel-Meyer assessment of sensorimotor recovery after 
stroke, as described in P. W. Duncan, M. Propst and S. G. Nelson, "Reliability of the 
Fugl-Meyer Assessment Sensorimotor Recovery Following Cerebrovascular Accident," 
Phys. Therapy, Vol. 63, No. 10, pp. 1606-1610, 1983, each incorporated by reference into 
this applicant. Grip strength evaluation using a dynamometer was obtained pre-, intra-, 
and post-training. In addition, subjective data regarding the subjects' affective evaluation 
of this type of computerized rehabilitation was also obtained pre-, intra-, and post-trial 
through structured questionnaires. Each subject was evaluated initially to obtain a 
baseline of performance in order to implement the initial computer target levels. 
Subsequently, the subjects completed nine daily rehabilitation sessions that lasted 
approximately five hours each. These sessions consisted of a combination of virtual 
reality simulations of exercises 41-44 using the PC-based system that alternated with 
non-computer exercises. Cumulative time spent on the virtual simulation exercises 41-44 
during each day's training was approximately 1-1.5 hour per patient. The remainder of 
each daily session was spent on conventional rehabilitation exercises. Although a 
patient's "good" arm was never restrained, patients were encouraged to use their 
impaired arms and were supervised in these activities by a physical or occupational 
therapist. Conventional exercises comprise a series of game-like tasks such as tracing 2- 
D patterns on paper, peg-board insertion, checkers, placing paper clips on paper, and 
picking up objects with tweezers. 

A. Patient Information 

Three subjects, two male and one female, ages 50-83, participated in this study. 
They had sustained left hemisphere strokes that occurred between three and six years 
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prior to the study. All subjects were right hand dominant and had had no therapy in the 
past two years. Two of the subjects were independent in ambulation and one required the 
assistance of a walker. None of the subjects was able to functionally use his or her 
hemiparetic right hand except as a minimal assist in a few dressing activities. 
B. Baseline Patient Evaluation 

Each virtual reality based exercise session consisted of four blocks of 10 trials 
each. Multiple sessions were run each day for five days followed by a weekend break and 
another four days. An individual block concentrated on performing one of exercises 41- 
44. Similar to the evaluation exercises, the patients were required to alternate between 
moving the thumb alone and then moving all the fingers together for every exercise 
except fractionation. The patient had to attain a certain target level of performance in 
order to successfully complete every trial. For a particular block 52a-52d of trials 54a- 
54d the first set of targets were drawn from a normal distribution around the mean and 
standard deviation given by the initial evaluation baseline test. A normal distribution 
ensured that the majority of the targets would be within the patient's performance limits, 
but the patient would find some targets easy or difficult depending on whether they came 
from the low or high end of the target distribution. Initially, the target means were set 
one standard deviation above the patient's actual measured performance to obtain a target 
distribution that overlapped the high end of the patient's performance levels. 

The four blocks 52a-52d of respective exercises 41-44 were grouped in one 
session that took 15-20 min to complete. The sessions were target-based, such that all 
the exercises were driven by the patient's own performance. The targets for any 
particular block of trials were set based on the performance in previous sessions. 
Therefore, no matter how limited the patient's movement actually was, if their 
performance fell within their parameter range then they successfully accomplished the 
trial. Each exercise session consisted of four blocks 52a-52d of exercises 41-44 of 10 
trials each of finger and thumb motions, or for fractionation only finger motion. The 
blocks 52a-52d were presented in a fixed order. 

Fig. 12a represents the change in thumb range of motion for the three patients 
over the duration of the study. Data are averaged across sessions within each day's 
training. Calculation of improvements or decrements is based on the regression curves fit 
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to the data. It can be seen that there is improvement in all three subjects, ranging from 
16% in subject LE, who had the least range deficit, to 69% in subject DK, who started 
with a very low range of thumb motion of 38 degrees. Fig. 12b shows that the thumb 
angular speed remained unchanged (an increase of 3%) for subject LE and improved for 
the other two subjects by 55% and 80%, patient DK again showing the largest 
improvement. Fig. 12c presents the change in finger fractionation, i.e., the patients' 
ability for individuated finger control. For patients ML and DK, this variable showed 
improvement of 11% and 43%, respectively. Subject LE showed a decrease of 22% over 
the nine days. Fig. 12d shows the change in the average session's mechanical work of 
the thumb for the nine rehabilitation sessions. The three patients improved their daily 
thumb mechanical work capacity by 9-25%. 

Figs. 13a-13b show the patients' grasping forces measured with a standard 
dynamometer at the start, midway and at the end of therapy, for both the "good" (left) 
and affected (right) hands. It can be seen that all three patients improved their grasping 
force for the right hand, this improvement varying from 13% for the strongest patient to 
59% for the other two. This correlates substantially with the 9-25% increase in thumb 
average session mechanical work ability shown in Fig. 12d for two of the patients. 
Patient LE had no improvement in his "good" hand and 59% improvement in his right- 
hand grasping force. Two of the patients had an improvement in the left-hand grasping 
force as well. Patient DK has a remarkably similar pattern in the change in grasping 
force for both hands. Other factors influencing grasping force capacity, such as self- 
motivation, confidence, and fatigue may be combined with influences from virtual 
simulation of exercises with rehabilitation device 10. 

If patient fatigue occurred, that may be correlated with the drop in right-hand 
grasping force shown in Fig. 13 for patient DK between the middle and end of therapy. 
The total daily mechanical work (sum of thumb effort over all sessions in a day) is shown 
in Fig. 14. Although the regression curve is positive for all three patients, daily values 
plateau and then drop for patient DK. 

All three subjects showed positive changes on the Jebsen test scores, with each 
subject showing improvement in a unique constellation of test items. None of the tasks 
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that were a part of the Jebsen battery was practiced during the non- virtual reality training 
activities. 

Subsequently rehabilitation system 10 was tested on four other patients that had 
left-hand deficits due to stroke. As opposed to the first study, this time only virtual 
5 reality exercises of the type shown in Figures 5-8 were done. There was no non-VR 
exercises done by the patients. 

Each of four patients exercised for three weeks, five days/week, for 
approximately one and half hours. The structure of the rehabilitation was previously 
described. Similar improvements in finger range of motion, fractionation, speed of 
1 0 motion and strength were observed. 

Figure 1 5 shows the improvement for the four patients over the three weeks of 
therapy using the rehabilitation system 10. It can be noted that three subjects had 

^ substantial improvement in range of motion for the thumb (50-140%), while their gains in 

Q 

Q finger range were more modest (20%). One patient had an 1 8% increase in thumb speed 
M 15 and three had between 10- 15% speed increases for their fingers. All patients improved 

*f their finger fractionation substantially (40-1 18%). Only one subject showed substantial 

m gain in finger strength, in part due to unexpected hardware problems during the trial. 

I it This subject had the lowest levels of isometric flexion force prior to the therapy. 
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Figure 16 shows the retention of the gains made in therapy in the two patients that 
were measured, again for the four variables for which they trained. Their range and 
speed of motion either increased (patient RB) or decreased marginally (patient FAB) at 
one-month post therapy. Their finger strength increased significantly (about 80%) over 
the month following therapy, indicating they had reserve strength that was not challenged 
during the trials. 

Figure 17 shows the results of the Jebsen evaluation, namely the total amount of 
time it took the patients to complete the seven component manual tasks. It can be seen 
that two of the patients (RB and EM) had a substantial reduction in the time from the 
measures taken prior to the intervention (23-28%, respectively). There was essentially no 
change in the Jebsen test for the other two patients (JB and FAB). Most of the gains 
occurred early in the intervention, with negative gains in the second half of the trials. 

Figure 18 shows the transfer-of-training results for a reach-to-grasp task, 
measuring the time it took patients to pick up an object. There was no training of this 
particular task during the trials. However, results indicate improvements in impairments 
appeared to transfer to this functional activity, as measured by the reduction in task 
movement time. Three of the patients had improvements of between 15% and 38% for a 
round object and between 9% and 40% for a square object. There was no change for 
subject RB for picking up a square object while the time to pick up a round object 
increased by about 11%. 

It is to be understood that the above-described embodiments are illustrative of 
only a few of the many possible specific embodiments which can represent applications 
of the principles of the invention. Numerous and varied other arrangements can be 
readily devised in accordance with these principles by those skilled in the art without 
departing from the spirit and scope of the invention. 
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